A generalized Faddeev's axiom and the uniqueness theorem for 

Tsallis entropy 

Shigeru Furuichi 1 * 

1 Department of Electronics and Computer Science, 
Tokyo University of Science, Yamaguchi, 756-0884, Japan 

Abstract. The uniequness theorem for the Tsallis entropy by introducing the generalized 
Faddeev's axiom is proven. Our result improves the recent result, the uniqueness theorem for 
Tsallis entropy by the generalized Shannon-Khinchin's axiom in [7], in the sence that our axiom 
is simpler than his one, as similar that Faddeev's axiom is simpler than Shannon-Khinchin's 
one. 

Keywords : generalized Faddeev's axiom, uniqueness theorem and Tsallis entropy 
2000 Mathematics Subject Classification : 94A17, 46N55 

1 Introduction 

As a typical feature of Shannon entropy 



n 



St(X) = -J^^ogxi (1) 



i=l 



defined for the probability distribution pi = p(X = X{) of the random variable X, the additivity 

S 1 (XxY) = S 1 (X) + S 1 (Y) (2) 

for two independent random variables X and Y is known. The additivity also holds for Renyi 
entropy ^ [2] which is famous as a generalization of Shannon entropy. 
As an another generalization of Shannon entropy, Tsallis entropy 

n 

S q (X) = -J2*> q Xi, (3) 

i=i 

where g-logarithm function ln^ is defined by ln g (x) = for q > and x > 0, was introduced 
in [3] with different mathematical feature from Renyi entropy, since acutually Tsallis entropy 
does not have the additivity as it will be noted in the below. Since (/-logarithm function ln g (x) 
uniformly converges to log x as q — > 1 for x > by Dini's theorem, Tsallis entropy converges to 
Shannon entropy as q — > 1, which means Tsallis entropy is one parameter extension of Shannon 
entropy. Also since q- logarithm function ln g (x) has the pseudoadditivity : 

ln q (xy) = InJx) + InJy) + (1 - q) ln q (x) ln q (y), (q + 1), (4) 
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Tsallis entropy has the pseudoadditivity 



S q (X xY)= S q (X) + S q (Y) + (1 - q)S q (X)S q (Y), (q + 1). (5) 

As a similar generalization of Shannon entropy, the structural a-entropy 0] or called the 
entropy of type /3 [Sj is traditionally known [Hj . These entropies are classified into the nonexten- 
sive (nonadditive) entropies since they do not have the additivity for two independent random 
variables X and Y, while Shannon entropy and Renyi entropy are classified into the extensive 
(additive) entropies. 

Recently, the nonextensive entropies including the Tsallis entropy was characterized by 
H.Suyari in terms of the generalized Shannon-Khinchin's axiom in [7]. See also [I] for the 
uniqueness theorem by a generalization of the Shannon-Khinchin's axiom for the structural a- 
entropy which is one of the nonextensive entropies, as a first appearance of such a generalized 
result. In the previous paper, we developed these works to the characterization of the Tsallis 
relative entropy |S]. Historically, the Shannon-Khinchin axiom [S] was improved by A.D.Faddeev 
[TUj in the sense that Faddeev's axiom is simpler than Shannon-Khinchin's one. The proof of 
the uniqueness theorem for Shannon entropy by means of the weaker condition than the original 
condition of Faddeev's axiom was completed by H.Tveberg in See also ^1 EH EEH for 

the details. Inspired by this fact and the recent fine result [Jj, in this short paper, we simplify 
the generalized Shannon-Khinchin's axiom [7j as the generalization of the Faddeev's axiom, and 
then prove the uniqueness theorem for Tsallis entropy. 



2 A generalized axiom and the uniequeness theorem 

We suppose that the function S q (xi, ■ ■ ■ , x n ) is defined for the n-tuple (aci, • • • , x n ) belonging to 
An = {{Pi-, • • • ,Pn) \ Y17=l Pi = 1>P» — (* = 1j 2) • • • j n )} an d takes values in R + = [0, oo). In 
order to characterize the function S q (xi, ■ ■ ■ ,x n ), we introduce the following axiom which is a 
slight generalization of Faddeev's axiom. 

Axiom 2.1 (Generalized Faddeev's axiom) 

(GF1) Continuity: The function f q {x) = S q (x, 1 — x) with a parameter q > is continuous on 
the closed interval [0, 1] and f q (xo) > for some xq € [0, 1]. 

(GF2) Symmetry : For arbitrary permutation {x' k } € A n of {xfc} G A n , 

S q (xi, • • • , x n ) = S q (x 1 , • • • , x n ). (6) 



(GF3) Generalized additivity : For x n = y + z, y > and z > 0, 

' y z 



S q (xi, ■■■ , x n - lf y, z) = S q (xi, • ■ ■ , x n ) + x q n S q ( — , — ) . (7) 

Xn X n 



The conditions (GF1) and (GF2) are just same with the original Faddeev's conditions except 
for the addition of the parameter q. The condition (GF3) is a generalization of the original 
Faddeev's additivity condition in the sense that our condition (GF3) uses the x n as the factor 
of the second term in the right hand side, while original condition uses x n itself as the factor of 
that. It is notable that our condition (GF3) is a simplification of the condition [GSK3] in the 
paper (7J. since our condition (GF3) does not have to take the summation on i from 1 to n. 

For the above generalized Faddeev's axiom, we have the following uniqueness theorem for 
Tsallis entropy. 
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Theorem 2.2 Three conditions (GF1),(GF2) and (GF3) uniquely give the form of the function 
S q : A n — > R + such that 

n 

S q (xi, ■■■,X n ) = -Xg^xflngXi, (8) 
i=l 

where X q is a positive constant number depending on the parameter q > 0. 

(Proof) In the special case of q = 1, the theorem follows by Thus we suppose g ^ 1 in 
the sequel. We prove the theorem as similar way of the proof by H.Tveberg From (GF2) 
and (GF3), for any x, y, z satisfying x, y > 0, z > and x + y + z = 1, we expand S q (x, y, z) into 
the different equations, 

S q (x,y,z) = Sq{x,y + z) + {y + z) q Sq[—^—,——\ 

\y + z y + zj 

= S q (y,X + Z) + (X + z) q S q 

Therefore we have 



x z 



X + Z X + z 



u- r) + [l - - r] "- r " ( rh) = f ^ + C 1 - ^"^ ) ((,) 



Since Eq.@ is defined for any < x < 1 and < y < 1, by setting x = and y > 0, we have 

/ 9 (0) + / 9 (y) = / (? (y) + (l-y) <? / 9 (0). 

Thus we have 

S q (0, 1) = /,(0) = 0. (10) 

Integrating both sides in Eq.@ with respect to y from to 1 — x, we have 
J o X f q (x)dy + (l-x) q J o X f q (-JL-\dy = J o * f q (y)dy + £ * (1 - y) " f q (-^-\ dy, 
which can be deformed as follows 

(1 - X) fq (X) + (1 - X) q+1 I f q (t) dt= I X fq (t) dt + X q+1 f t~ q ~ 2 f q (t) dt . (11) 

JO JO Jx 

Since the function f q (x) is continuous on the closed interval [0, 1] due to (GF1), it is differentiable 
on the open interval x G (0, 1). By differentiating both sides of Eg. (jllj) and applying the relation 

fq(x)=fq(l-x) (12) 

due to (GF2), we have 

(1 - x) fq (x) = (q + 1) (1 - x) q f 1 fq (t) dt + (q+ 1) x q f 1 t- q - 2 f q (t) dt - ^M. (13) 

JO Jx X 

Again differentiating both sides in Ea. ()13|) . we have 

(l-x)/;(x) = -,(?+l)(l-.) H //,(*) dt + q{q+l) x'- 1 ! t-- 2 f,(t)dt 
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Multiplying x to both sides in Ea.l|14|). we have 

x (1 - x) f' q ' (x) = -q (q + 1) x (1 - x)^ 1 / /, (t) dt + « (q + 1) x« /' t^- 2 f q (t) dt 

JO Jx 

_sfM + {x -i)f {x) . (15) 

x y 
Also multiplying q to both sides in Ea.(|13[). we have 

q (1 - x) f' q (x) = q (q + 1) (1 - x) 9 /' /, (t) dt + q(q+l) x" [' t~ q ~ 2 f q (t) dt - (16) 

JO Jx x 

From Ea. (|15|) and Ea. (|16|) . we have the following differential equation : 

xf q ' [x) = (q-l) f q (x) - q (q + 1) ^ (1 - x) q ~ 2 , (17) 

where we set \i q = f q (t) dt. This differential equation has the following general solution with 
the constant numbers c\ and C2 : 

/g(x) = ci+c 2 1 . (18) 

q 1-q 

The initial condition Ea. ()l(J|) implies c\ = q_^ q ■ Also the condtion Ea. 1)121) implies C2 = 

_ Substituting c\ and C2 into Eq,(|18|). we have 

f q {x) = —X q {x q In, x + (1 - x) 9 ln 9 (l - x)} , (19) 

after the calculations, where we again set X q = (q + l)n q . Since there exists some to £ [0, 1] 
such that f q (to) > due to (GF1) and the range of S q is R + , we have fj, q > and then we have 
A g > for any q > 0. Therefore we could prove Eq.(jSJ) for n = 2. Finally we prove Eq.Q for the 
general n > 3 by induction on n. On the assumption that Eq.(JHJ) is true for any n, the following 
calculations directly follow. 



S q (Xi, • • • , x n , x n _)_i) — <Sg (xi, • • • , x n + X n+ i) + (x n +X n+ i) Q S q 



Xn+1 



X n -\- X n +1 X n + X n -)_l 



n-1 



-A y ^ X 9 ln q Xi - Xq (X n + X n+ l) q klq (X n + X n+ l) 



i=l 

-X q (x n + x n+ i) q \[ ^ J ln q ( ^ ) + ( — — ) ln g ' 



Xn "I - %n-\-\ J \ *^Jl "I - -^n+l / V x n ~\~ Xn+1 / \ Xn -|- X n +1 

Xn T Xn+l J 



n-1 



i=l 



-A 9 x n In, — — - X q x q n+1 ]n q 



Xn \ \ t_ | X n -)-l 



Xn "I - X n -|-1 / V ""w ^n+l 



n-1 



-Xq^x q ln q Xi + Ag (x„ + x„+i) ln 9 — 

X n + X n -|-1 



i=l 



-AgX n ( ln g x„ + x n 9 In, — — ) - A 9 x« +1 ( In, x n+l + x* + j ln ? — — ) 

\ X n ~r X n +1 / \ X n -|- X n +1 / 

n+1 

i=l 

This shows that Eg. ([8]) is also true for n + 1. Thus the proof of this theorem completed. 
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3 A relation to the generalized Shannon-Khinchin's axiom 

In this section, we study the relation between the generalized Shannon-Khinchin's axiom intro- 
duced in [7j and the generalized Faddeev's axiom presented in the previous section. To do so, 
we review the generalized Shannon-Khinchin's axiom in the following. 

Axiom 3.1 (Generalized Shannon-Khinchin's axiom) 

(GSK1) Continuity: The function S q : A n — ► R + is continuous. 



(GSK2) Maximality: 



max {Sq(X) : Xi € A n } > 0. 



1 \ ' ' , 

Xi Xi 



(GSK3) Generalized Shannon additivity: For Xij >0,Xi = x iji = 1 , • • • , rx; j = 1 , ■ • • , mi), 

n 

Sq{x\\ , • • • , X nrrin ) — Sq^X\ , ' ' ' , Xn) + ^ X^ Sq 

i=l 

(GSK4) Expandability: S q (xi, ■ ■ ■ , x n , 0) = S q (xi, ■ ■ ■ , x n ). 

We should note that the above condition (GSK4) is slightly changed from [GSK4] of the original 
axiom in [7]. Then we have the following proposition. 

Proposition 3.2 Axiom I3~T1 implies Axiom |2~T1 

(Proof) It is trivial that (GSK1) and (GSK2) imply (GF1). We show that (GSK1) and 
(GSK3) imply (GF2). If all Xi, {i = 1, ■■■,n) are positive rational numbers, each Xi can be 
represented by ^, (2 < k < m, k,m G Z). Applying (GSK3), since Xi = ^ = J2j=i ^> we ^ ave 



S q (xi 



i Xr. 



S n 




q ... ... ... 



h 




m ' 


m J 




\ 


1 


1 


m' 


' m 


L I 



The first term of the right hand side in the above equation does not depend on the order of 
(li, ■ ■ ■ , l n ). Also the way to take the summation in the second term of the right hand side in 
the above equation is arbitrary so that the above equation is equal to 



1 



1 

m ' 



1 



1 

m 



V 



III 

^ x 'i q Sq 

1=1 



) 



for the permutation {x[} from {x{\ where x\ = (2 < l\ < m, l[,m G Z). That is, (GF2) 
holds for any rational numbers Xj. If Xi is not the rational number, then we use the continuity of 
(GSK1) after the approximation of Xi by the rational number, and then we have (GF2). Finally 
we show that (GSK3) and (GSK4) imply (GF3). From (GSK3), (GSK4) and (GF2), we have 



S n 



1 1 

2' 2 



Sn 



i, !,o,o 

2 2 



S "^^j + ^ (1 ' 0) + #^ (1 ' 0) - 



1 



1 
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Therefore we have S q (l,0) = 0. Thus we have 

S q Oi, • • • , x„_i, y, z) = S q (xi, 0, x 2 , 0, ■ • • , x„_i, 0, y, z) 

n-1 , x 

= Sg (Xl, • • • ,X n ) + ^2x Q i S q (1,0) +X q n S q I , ) 

\ %n x n / 

= Sq (xi , ■ • • , X n ) + X^Sq ( , J , 

V x n x n J 

which implies (GF3). 

■ 

We also have the following proposition. 

Proposition 3.3 S q (X) = — X q Y17=i x i m <? x i satisfies Axiom l3~Tl 

(Proof) (GSK1) and (GSK4) are trivial. We prove (GSK2) by the use of the non-negativity 
of the Tsallis relative entropy: 



D,(X|Y) = -5>ih*^ 
. , x i 

i=i 

for two random variables X and Y, where {xi} and {yi}, (i = 1, •••,n) are probability dis- 
tributions of X and Y, respectively. See |15| for the mathematical properties of the Tsallis 
relative entropy. Its non-negativity can be easily proven by the convexity of — ln q (x). The 
non- negativity implies S q (X) < ln q n by setting the random variable U = {„j"">^:} having 
the uniform distribution instead of Y. We easily find that the maximum value is attained when 
X = {-,••• -}■ Note that X q does not depend on the way to take the maximum of S q (X). Thus 
(GSK2) is proven. Finally (GSK3) is proven by the direct calculations. 



n / 
Sq (Xl, • • • , X n ) + ^ ^ x \Sq I 

i=l V Xi 



irrii 
j * * * 5 " 



^1 X] X i ln< ? Xi + X ± S 4 (^'""'"^P") ^ ^ X n S q {^ nl 



1 1 

X-n. %r 



- -A, ± x?ln,„ - V? { (SI) \ SI + . . . + (S^)'ln 3 Sf } 

— ax((— Ys— +•■■ + (— I 

= ~\ x^ ln 9 Xi - Ag I xf x ln 9 xn + xu ln q 1 h x\ mi hx q x lmi + x lmi ln q — ) 

. V %i x i J 

i=i 

... \q I X n ^ \llq X n i -\- X n \ ln^ |- • • • + X^ mi ln^ X nrHl + X nmi hlq J 

\ x n x n J 

f 1 1 \ 

= An I x\ \iin h ■ ■ ■ ~\~ x n ln^ I + S q (xn , • • • , x\ m , , • • • , x n \ , • • • , x nm ) 

V ^i x„y ^ 

-A g I (xn H h xi mi ) ln 9 — H h (x n i H h x nm?l ) ln 9 — 1 

L %1 %n ) 

— Sq (xn , • • • , X\ mi , " " " , X n \ , • • • , X nrrin ) . 

■ 

From Theorem 12.21 Proposition 13.21 and Proposition 13.31 we have the following equivalent 
relation among Axiom 12.11 Axiom 13.11 and the Tsallis entropy. 
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Theorem 3.4 The following three statements are equivalent to one another. 

(1) S q : A n — > R + satisfies Axiom IXT1 

(2) S q : A n -> R+ satisfies Axiom O 

(3) For (xi, • • • , x n ) € A n , there exists X q > such that 

n 

Sq{x±, • • • , X n ) = — Xq ^ ^ x\ ln<j Xj. 

i=l 

4 Conclusion 

As we have seen, Tsallis entropy was characterized by the generalized Faddeev's axiom which 
is a simplification of the generalized Shannon-Khinchin's axiom introduced in 0. And then we 
slightly improved the uniqueness theorem proved in 7 , by introducing the generalized Faddeev's 
axiom. Simultaneously, our result gives a generalization of the uniqueness theorem for Shannon 
entropy by means of Faddeev's axiom j 1 01 111] . 
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